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EXECUTIVE SUMMARY 



The goal of this report is to measure the institutional characteristics that affect the success of 
community college students, particularly low-income and minority students. While there is a 
growing literature on this topic for baccalaureate institutions, few researchers have attempted to 
address the issue for community colleges. Since this line of research is so new, there remain open 
many methodological and conceptual issues. 

Much research has been done to identify individual student characteristics that impact their 
outcomes at community colleges. Characteristics such as academic preparedness, household 
income, parents’ level of education, gender, race/ethnicity, and patterns of enrollment have all 
been found to impact individual student outcomes. Yet, individual factors cannot completely 
explain the graduation rates of different community colleges, nor even the likelihood of an 
individual student completing at a particular college. Evidence shows that different community 
colleges enrolling essentially similar types of students may have vastly different graduation rates. 
What characteristics of these institutions might play a role in explaining student outcomes, when 
controlling for student characteristics? This report investigates that question using different 
models and sets of data. 

The Study. In this study, a team of researchers at the Community College Research Center 
(CCRC) pursued two broad empirical strategies. First, we developed a model of the detenninants 
of institutional graduation rates using the Student Right-to-Know (SRK) three-year graduation 
rates published by the National Center for Education Statistics (NCES). We used measures of 
institutional characteristics provided by the Integrated Postsecondary Education Data System 
(IPEDS) as the independent variables (the detenninants of graduation rates). Second, we used 
individual data from the National Education Longitudinal Study of 1988 (NELS:88) to analyze 
individual student probabilities of completing a certificate or degree or transferring to a 
baccalaureate institution. Using this approach we were able to control for individual 
characteristics such as a student’s socioeconomic background or scores on pre-college 
assessment tests. We assessed the effects of institutional characteristics on individual student 
outcomes by linking the same institutional variables from IPEDS that we used in the institutional 
analysis to the individual student records (by the institution in which each student enrolled). 

There are strengths and weaknesses to the SRK institutional graduation rate data. The data are 
readily available from IPEDS for most colleges and therefore allow for easy analysis of the 
comparative perfonnance of individual colleges. Yet the SRK data are criticized because they 
poorly report transfer students who do not earn a degree prior to transfer, in effect assuming that 
all students want degrees. Furthermore, the three-year window for measuring community college 
graduation is too short — substantial numbers of community college students take longer than 
three years to complete an associate degree. In addition, IPEDS does not include many important 
variables that are known to influence graduation rates, with student economic background and 
pre-college academic records being the most important. These are all valid criticisms. However, 
we argue that the graduation rates are still important measures, especially when used 
comparatively, and that the distortion caused by transfers is not very large for three-year rates. 
Moreover, the institutional variables that are available from IPEDS allow us to make some 
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adjustments to the graduation rates, and therefore to calculate better comparative benchmarks 
than the raw graduation rates. 

Our second set of analyses that link the NELS:88 individual student outcomes and characteristics 
to the institutional variables from IPEDS address some of the problems with the SRK data. The 
individual outcome variable (individual degree completion or transfer) from NELS:88 is a more 
reliable measure than the SRK graduation rate, while the individual student data allow us to 
control for important background characteristics. Since NELS:88 includes student transcripts, we 
can also use credit accumulation as an outcome variable. Finally, NELS:88 also allows us to 
track students for up to eight years, rather than the three years for the SRK rates. 

Even with NELS:88 some analytic problems remain. For example, we still must rely on the 
crude institutional measures available in IPEDS. So, while we may know that an individual is 
from a low-income family, we have no reliable information on the economic background of the 
typical student at that individual’s college. And we still do not have measures of specific 
institutional policies such as the types of student services or pedagogic strategies typically used 
to improve retention and completion. Finally, the NELS:88 sample is made up almost entirely of 
traditional-age college students, and therefore provides no information on older students, who 
comprise an important part of community college enrollments. 

Findings. The results discussed here are based on the most salient findings from both the 
institutional graduation rate analysis and the individual student outcomes analysis. Community 
college characteristics that exhibit consistent impacts on student outcomes are as follows. 

Institution size is negatively correlated with successful student outcomes. Students complete at 
higher rates in smaller community colleges, perhaps because such institutions can provide a more 
personalized environment. It may also be that smaller institutions have a more limited and 
focused set of programs, which may attract students who know what they want or provide a 
structure to guide students who do not know what they want toward a clearer set of outcomes. 

A larger percentage of minority students (black, Hispanic, and Native American) at an 
institution is associated with lower graduation rates. Students in colleges with more minority 
students graduate at lower rates, even after controlling for the race of individual students. Thus, 
the graduation rates at colleges with many minorities is lower, not because minorities are less 
likely to graduate and therefore lower the graduation rate, but rather because all students tend to 
graduate at lower rates when they attend high minority colleges. This is certainly a disturbing 
conclusion that needs further investigation. 

Higher percentages of students who are part-time tend to be related to lower graduation rates. 
Like the finding with minority students, the proportion of part-time students at the institution is 
the significant variable in this finding - and not necessarily the intensity of enrollment of any 
individual student. 

A larger percentage of faculty who are part-time also correlates with lower student graduation 
rates at community colleges. 
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Rates of instructional expenditures and student service expenditures have some positive impacts 
on graduation rates. More instructional expenditures appear to promote completion in the 
institutional analysis using the SRK graduation rate, but this effect disappears when we control 
for individual student characteristics. On the other hand, expenditures on student services are not 
related to higher graduation rates in the SRK analysis, but in some permutations of the model 
that include individual characteristics, we find a positive relationship between outcomes and 
student services expenditures. The latter suggests that student services may be effective in 
increasing the probability that a student will have a positive outcome. In sum, these results 
suggest that cuts in instructional expenditures and student services will lower college 
performance and thwart retention and completion. 

The state in which a college is located has significant impact on institutional graduation rates. 
Dummy control variables for each state in the SRK graduation model helped explain much of the 
variation in institutional graduation rates, suggesting that state policies and how they play out at 
individual community colleges matter for student outcomes. These effects seem to be 
independent of the effect of the level of expenditures by individual institutions, although they 
may have to do with the level of state appropriations, something we do not measure. Other recent 
research on the impact of institutional finances on student persistence at baccalaureate 
institutions finds that the percent of revenue derived from tuition is positively related to student 
persistence. The explanation for this effect is that, as institutions rely more on tuition for 
revenue, they become increasingly customer focused. This may also be true at community 
colleges, and may be an important finding as competition intensifies for state and local funding. 
Therefore, individual state-level variables that distinguish funding and other policies might tease 
out differences in outcomes - including, perhaps, the outcomes for minority students and other 
student populations. 

Implications. As indicated, this research identified several important methodological issues that 
should be noted and must be addressed in future research. Similarly, the findings suggest 
directions for future research that may tease out some of the pedagogical, practical, and policy 
features of individual states or institutions. They are noted below. 

There are important contrasts between the findings for all community college students and for 
those in an associate degree program. These contrasts suggest that certificate and associate 
programs have different dynamics, and policies that promote success in one might not work for 
the other. We suspect that the contrasts would be even larger if we had a more representative 
sample of community college students than is available in NELS:88. NELS:88 is comprised 
primarily of traditional aged college students. Adult community college students are more likely 
than younger students to enroll in certificate programs and probably also respond differently to 
particular types of policies and practices. 

Conventional models of institutional performance appear to work better for baccalaureate 
institutions than they do for two-year institutions. One reason why is that baccalaureate 
institutions have a much simpler and more universally applicable outcome measure - attainment 
of a bachelor’s degree. In contrast, community college students have a wider variety of goals, 
including certificates, occupational and academic associate degrees, transfer, and many personal 
objectives that do not even include a credential. Furthermore, this finding suggests that we 




simply have a much weaker understanding of the determinants of student success in community 
colleges than we do in baccalaureate institutions. This is not surprising since the vast majority of 
both theoretical and empirical work on completion and retention is focused on the baccalaureate 
sector. 

Incorporating more accurate measures of the important student characteristic of socioeconomic 
status (SES) might strengthen the explanatory power of the models. Our research contains no 
measure of the institutional average student income (which is found to be positively associated 
with degree completion in the literature), though we used as a proxy federal aid per full-time 
equivalent (FTE) student. This was generally insignificant in our models, although it reduced the 
likelihood of associate degree program completion. 

Overall, the individual student characteristics appear to be more important determinants of 
graduation and retention than the institutional variables. Even though we include controls for 
institutional variables as well as for individual effects, the results are consistent with analyses 
that only include individual characteristics. And, when we add individual variables to analyses 
using institutional variables, many of the institutional effects weaken: we get strong and 
consistent effects only for enrollment size and minority enrollment. This finding suggests that 
some of the measured institutional effects in the first analysis actually result from the individual 
characteristics of students that are correlated with institutional variables. Clearly, controlling for 
individual characteristics yields more reliable results. 

There may be several explanations for this apparent importance of individual characteristics. 
First, well-prepared students with economic resources may be likely to survive and perhaps do 
well in a variety of institutions. Likewise, students with many barriers may have trouble even in 
strong colleges. Alternatively, the magnitude of some variables may reflect a college’s response 
to perceived student needs as well as to some exogenously detennined institutional policy. For 
example, colleges whose students face multiple barriers may spend more on student services. 
While we have tried to control for student characteristics, there may be important factors that are 
not measured in our datasets. If this is true, even if student services are effective in increasing 
retention, the negative effect of having many students who face barriers to completion may offset 
the positive program effect, showing a result that suggests no effect. Finally, we may simply not 
have data on the most effective institutional policies. Since good national survey data on 
institutional practices are not available, we must rely on field research to identify differences in 
practices that might explain differences in student outcomes by college. We suspect that, at the 
institutional level of analysis, one can observe policies and practices that would specifically 
affect the outcomes of minority students and students who enter community college with 
economic or educational disadvantages. 

The limitations of national survey data for examining institutional practices and the evident 
importance of state policy in shaping student outcomes have led us to pursue research using data 
from particular states that collect longitudinal data on students. With individual student data 
across all state colleges combined with the specific state financial and policy variables, we can 
produce much more robust models that can identify effective practices that promote student 
completions. CCRC has begun to analyze data on student performance from Florida and 
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Washington State that will allow us to answer questions that cannot readily be addressed using 
national datasets. 

We have made considerable progress in understanding the factors that influence college 
performance, but the larger project of identifying community college characteristics and policies 
that promote student success is still at an early stage. The overall strategy needs to be multi- 
pronged. Both quantitative and qualitative approaches need to be used. The growing availability 
of state unit record data needs to be encouraged and exploited. Results from state analyses can be 
compared to conclusions using national data to check the accuracy of the latter. The quality and 
quantity of national NCES data must be enhanced. One important step is that NCES will soon 
release retention rates as well as graduation rates. Methods should be developed to collect more 
fine-grained quantitative data on institutional activities and practices. Qualitative methods such 
as case studies of colleges and states with higher than expected graduation rates will yield 
important insights. A comprehensive approach to this problem is needed to develop a reliable 
understanding of the policies and practices that can improve outcomes for low-income, minority, 
and, indeed, all community college students. 



v 




THE EFFECTS OF INSTITUTIONAL FACTORS 
ON THE SUCCESS OF COMMUNITY COLLEGE STUDENTS 



Introduction 



Community colleges are the gateway to higher education for many students who would 
otherwise have limited access to college. College students who are from minority populations or 
low-income households, first-generation enrollees, or immigrants are overrepresented in 
community colleges. Research shows that many of these students would not be in college at all if 
they did not have access to these low-cost institutions which are distributed across states to be 
within commuting distance of the vast majority of the population (Alfonso, 2003; Kane & Rouse, 
1999). But much work remains to be done before class, race, and ethnicity cease to be central 
determinants of the college education that an individual receives. Only about one third of all 
community college students receives any degree or certificate, even eight years after initial 
college enrollment. Twenty percent do not complete ten credits in that period of time. Credit 
accumulation and completion rates are even lower for minority and low-income students. 

What can be done to improve the success of community college students once they have enrolled 
in college? Many baccalaureate institutions improve their completion rates by judiciously 
selecting their students. Nothing can boost completion rates more than raising the SAT scores of 
entering students. But this is not an option for community colleges. Indeed such a strategy 
violates the principle of open admissions which is central to the community college movement. 
Another potential alternative involves making changes in the educational, social, and policy 
environment in which the colleges operate. We know that many community college students 
confront work and family challenges that complicate their education. Thus, employment, flexible 
welfare regulations, publicly funded day care, need-based financial aid, public transportation, 
and many other social policies could have profound positive effects on college success. A 
comprehensive solution to the problem of college access and success will in the end require such 
broader social and economic policy changes. But, for the most part, such measures are not under 
the control of the colleges. 

This report focuses on policies and programs that colleges themselves might be able to 
implement to improve student success. Even though community colleges are similar types of 
institutions on many levels, there is wide variation among colleges in various student outcome 
measures such as graduation, transfer, and retention. The central premise of this report and the 
broader research program, of which the report is one component, is that there are important 
lessons and insights that can be learned from this variation. Why do some colleges have higher 
graduation rates than others? Can these differences be attributed to different institutional 
characteristics or practices that can be emulated by other colleges? 

There are many factors that might cause variation in student success. A great deal of research 
suggests that students who attend part-time, come from lower income households, or have 
weaker academic skills tend to complete at lower rates. So, for example, two colleges with 
different graduation rates may actually be equally effective if the college with lower rate enrolls 
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a larger proportion of students from lower income families. State policies that affect tuition 
levels and financial aid or that create incentives for certain types of college practices also may be 
influential. Therefore, any research that tries to relate outcomes to institutional practices must 
also take account of individual student and policy factors that might explain graduation rates. 

These factors must also be taken into account when graduation rates are used for purposes of 
accountability, that is, to judge the performance of an individual college. Failing to control for 
students’ academic readiness unfairly penalizes institutions, such as community colleges, which 
enroll less well prepared students and gives undeserved credit to those with selective admissions 
policies. 

This report also serves as an important component of a Ford Foundation- funded study on 
minority degree attainment at community colleges. In two descriptive reports prepared as part of 
that study (see Bailey, Jenkins, & Leinbach, 2005a, 2005b), we saw that the rates of degree 
attainment and transfer of black and Hispanic, as well as low-income and first-generation college 
students, are lower than the rates for whites, those from higher income households, and those 
whose parents earned college degrees. However, student background and characteristics are not 
the sole factors influencing postsecondary achievement. Therefore, this analysis is a first step 
toward better understanding what other factors - in this case institutional factors - affect student 
outcomes. 

The research reported here used institution-level data available from the Integrated 
Postsecondary Education Data System (IPEDS) of the National Center for Education Statistics. 
We used both the institution-reported graduation rates and the institutional characteristics data 
available in IPEDS. These data include student characteristics; institutional characteristics, such 
as location and enrollment size; and some financial characteristics, including expenditures for 
various types of services. The analysis attempts to understand the ways that these factors are 
related to student outcomes, as measured by graduation rates. 

The structure of this report is as follows. We begin in Section II with a discussion of the 
relevance of institutional graduation rate data, examining the important limitations to the use of 
this information, but also the valuable insights that it can provide about the effectiveness of 
community colleges. Section III contains a review of the existing literature addressing graduation 
rates and the factors that affect these rates at both baccalaureate institutions and community 
colleges. 

Then, in Section IV, we introduce the model we developed using exclusively IPEDS data to 
measure the institutional effects on community college graduation rates, and report the findings 
and conclusions from this analysis. The analysis has two goals. First, it measures the relationship 
between institutional characteristics and graduation rates. Second, it allows us to evaluate the 
performance of individual institutions after taking into account those characteristics and practices 
that are measured in IPEDS. Even after taking the factors into account, wide variations in 
institutional completion rates remain. The next step in this research program, then, will be to use 
a variety of quantitative and qualitative methods to try to identify the institutional practices that 
explain the remaining variation. 
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IPEDS data have two drawbacks. First, they do not allow us to control for many characteristics 
that may contribute to student outcomes. For example, IPEDS does not include data on the 
academic skills of entering students. As a result, we perfonned an additional analysis of 
institutional effects on student outcomes using data from the National Education Longitudinal 
Study of 1988 (NELS:88). Merging the individual student characteristics and eight-year student 
postsecondary outcomes from NELS:88 with the institutional characteristics from IPEDS allows 
us to control for those student characteristics that might influence outcomes. It also permits a 
better understanding of the effects of institutional characteristics. Unfortunately, it does not allow 
us to analyze or judge the performance of any individual institution. 

A second problem is that IPEDS does not include measures of many of the institutional policies, 
such as pedagogic strategies, student services, or developmental education programs, which 
colleges use to improve student outcomes. Our long-term research strategy includes a plan to 
conduct qualitative case studies of colleges that vary in their performance according to our 
IPEDS derived measures. Thus our extensive quantitative analysis of national data will provide a 
foundation for more qualitative analyses based on institutional and particularly state-level data 
designed to identify more specific policies that promote student success. 

These plans are described in the conclusion to the report, Section V. This section also 
summarizes our overall findings and addresses their relevance to understanding factors 
influencing minority degree attainment at community colleges. We link the work in this paper 
with a companion report discussing findings from research on attainment by low-income adult 
students at community colleges in Washington State. 
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The Importance of Community College Graduation Rates 



A central purpose of this report is to determine the role that institutional characteristics play in 
influencing students’ outcomes. The most common and direct measure of community college 
student attainment is completion of a degree or certificate, or a transfer to a baccalaureate 
institution (collectively referred to here as completion). By identifying and implementing 
institutional practices and characteristics that contribute to completion, community colleges 
should be able to increase the rates of graduation and transfer among their students. 

Several forces are converging to bring about an increasing emphasis on community colleges’ 
completion rates, and it is important to consider whether they are valid indicators of student 
success. For example, many community college students benefit from the skills they learn in 
college, even if they never earn a degree (Bailey, Kienzl, & Marcotte, in press). This positive 
finding indicates the need to consider how much significance should be placed on completion 
outcomes. In this section we examine the growing emphasis on completion rates and discuss the 
controversy associated with that trend. We conclude that increasing degree completion and 
transfer rates should be central institutional goals, although other measures of student success 
should certainly be considered. 



Outcomes and Accountability 

Several recent developments are leading the public and policymakers to take a greater interest in 
measuring the perfonnance of higher education institutions by the outcomes of their students, 
particularly graduation rates. The popularity of college rankings such as those produced by U.S. 
News and World Report are a reflection of the increasing attention by the public toward 
measures of the quality of higher education. Furthermore, accrediting agencies, long criticized 
for an overemphasis on “inputs” such as the credentials of the faculty and the number of books in 
the library, are now beginning to focus more on outcomes. The North Central Association of 
Colleges and Schools and other accreditation agencies, for example, now require colleges 
seeking accreditation to give evidence of learning by all of their students, not just by those who 
complete programs. 

Policymakers are also demanding greater accountability. According to the Rockefeller Institute 
of Government at the State University of New York at Albany, 44 states issue annual “report 
cards” on their colleges, up from 30 in 2000 (“Linking Spending,” 2003). More than half the 
states now engage in “performance budgeting,” under which state officials, in drafting annual 
budgets, take into account the performance of public colleges. Eighteen states have performance 
funding schemes in which public colleges gain or lose set amounts of money based on how well 
they meet certain standards. 

In the 2004 debate over reauthorization of the Higher Education Act, the Bush administration 
articulated its desire to hold higher education to higher standards of accountability, just as it had 
with the public schools through the No Child Left Behind Act. Under the Higher Education 
Amendments of 1998, to be eligible to receive federal financial aid, colleges are required to 
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report graduation rates for cohorts of first-time, full-time (FTFT) students in 150 percent of the 
“traditional” graduation period (i.e. three years for associate degrees and six years for 
baccalaureate degrees). Beginning with the IPEDS 2002-03 survey, colleges are now required to 
report overall student graduation rates, as well as those for black, Hispanic, and female students. 
These are referred to collectively as the Student Right-to-Know (SRK) data, after the legislation 
that established the reporting requirement. 



The Accountability Debate and Graduation Rates at Community Colleges 

While the focus of policymakers’ increasing demands for accountability has been primarily on 
baccalaureate institutions, community colleges are unlikely to escape increased public scrutiny of 
their outcomes. As competition for public funding intensifies, and as community colleges are 
forced to compete both with other educational institutions - including the more politically 
powerful universities and K-12 systems - and with other non-education groups, such as seniors 
seeking support for health care and retirement (Kane, Orszag, & Gunter, 2003), community 
colleges will increasingly need to measure and document their outcomes and the returns on the 
public’s investment that they produce. 

Community college advocates have, however, resisted the use of completion rates either as an 
accountability measure or a normative goal. They have advanced three broad arguments for this 
stance. First, they argue that many students at community colleges are seeking neither degrees 
nor transfer to a baccalaureate institution. In many cases, students enroll with the goal of learning 
some specific skills, perhaps to gain a promotion at their current job. Indeed, in response to a 
question in the Beginning Postsecondary Students Longitudinal Study of 1996-2001 (BPS:96/01) 
asking community college students to report their “primary reason for enrolling,” 36 percent of 
the students in associate degree programs said that they either wanted to learn “job skills” or had 
enrolled for “personal enrichment.” 1 From this perspective, the range of non-degree outcomes of 
students may be an indication that community colleges are serving multiple student needs, as 
they are chartered to do. Criticizing colleges for low completion rates would reflect a 
misunderstanding of the mission of community colleges and the goals of their students. 

A second reason why community college advocates resist the use of completion as an 
accountability measure is that many factors that may thwart graduation are beyond the control of 
the colleges. Many community college students face serious barriers to success in college, such 
as family and work responsibilities and deficient academic preparation. Indeed, it is precisely 
students such as these, who may not have access to baccalaureate institutions, whom community 
colleges seek to serve. Furthermore, many of these barriers are not under the control of 
community colleges, nor can the colleges mitigate them. Therefore, advocates argue, community 
colleges should be neither criticized nor penalized for the failure of many of their students to 
complete. 

A third reason for resisting the use of graduation rates as a perfonnance measure is that, 
increasingly, college students may attend several colleges before completing their degrees. For 
example, one out of five students in the NELS:88 sample who earned a bachelor’s degree 



1 Authors’ calculations. 
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received it from a baccalaureate institution other than the one in which they enrolled initially 
(Adehnan, 2003). Adehnan pointed out that students change colleges for lots of reasons, stating 
in a recent article in The Chronicle of Higher Education, “Why should institutions be judged for 
choices, made by students, that are beyond their control? College students are legal adults, after 
all” (Burd, 2004, p.Al). 

Our own findings from BPS:96/01 indicate that up to 40 percent of first-time community college 

9 

students attended more than one institution during their six years of observation in the survey. 
Furthermore, we used BPS:96/01 to evaluate the difference between institutional graduation rates 
(the percent of an entering cohort that graduates within a given number of years from the 
institution of first enrollment) and individual graduation rates (the percent of entering students 
who graduate from any institution within a given number of years). We found that 23 percent of 
all first-time, full-time students in degree programs in BPS:96/01 graduated (earned a certificate 
or associate degree) from their institutions of first enrollment within three years. This is 
conceptually equivalent to the SRK graduation rate. Yet, 26 percent of first-time, full-time 
students earned a certificate or associate degree at any institution within three years. The 
comparison suggests that the difference between institutional and individual graduation rates is 
not that large for a three-year period. However, this difference is much greater for longer periods 
of time. Over a six-year period, while 28 percent of first-time, full-time students in degree 
programs in the BPS:96/01 sample earned a certificate or an associate degree from their initial 
institution, 46 percent earned a certificate or associate degree from any institution. Therefore, 
while institutional graduation rates do not significantly underestimate individual graduation rates 
over the three-year period that the NCES uses in its SRK data, institutional and individual 
graduation rates do diverge substantially as the time period increases to six years. 

These reasons against using completion rates as accountability measures for community colleges 
are all valid points. Community college students do have varied goals and many face particularly 
challenging barriers that are beyond the control of colleges. Many students also transfer to 
baccalaureate-granting or to other two-year colleges without earning a degree, reducing a 
college’s graduation rate while producing outcomes that may be positive for individual students. 
However, using the completion rates for measuring community college effectiveness is not 
without merit, as we argue in the next section. 



The Case for Using Graduation Rates 

As indicated, institutional graduation rates may underestimate individual graduation rates, yet 
there is still useful infonnation to be gleaned in examining differences among colleges in 
institutional graduation rates. Explaining why some colleges with similar characteristics and 
similar types of students have much higher rates than others might offer insights into policies and 
practices that could improve colleges’ effectiveness in serving students. In addition, any 
individual college can analyze its persistence and completion rates as important measures of the 
effectiveness of its policies and practices. 



2 Authors’ calculations. 
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Although — as already stated — institutional graduation rates taken alone can be misleading, there 
are reasons that college completion or transfer should be important goals for community college 
students. Research indicates that earning credits without completing a degree or certificate does 
have an economic value, but students get additional financial benefit from a credential (Bailey, 
Kienzl, & Marcotte, in press; Grubb, 2002). Indeed, for students in academic majors in 
community college, the real benefit comes from eventually earning a bachelor’s degree. There 
appears to be little economic return to a transfer-oriented education for students who do not 
transfer. Earning small amounts of credit in academic subjects also has no measured economic 
value. Therefore, research does not refute the argument that short-tenn course taking to upgrade 
skills can be valuable for students, but neither does it provide strong support for this hypothesis. 
In contrast, the literature consistently demonstrates the value of degrees, particularly bachelor’s 
degrees. For these reasons, it might be argued that even when students themselves do not seek 
degrees, community colleges should strive to raise those students’ aspirations, including helping 
them recognize the opportunities for advancement in education and subsequently in employment 
that can come with further education (Jenkins, 2003). 

The student-as-course-taker argument implies that enrollment in an associate degree program 
may overstate students’ goals, since some students may only want some specific skills that they 
can leam in a few courses. However, when students are asked about their long-tenn educational 
expectations, the goals almost always are equal to, and in most cases exceed, the level of the 
programs in which they are enrolled. For example, Figure 1 shows that 86 percent of students in 
community college associate degree programs in BPS:96/01 actually expected to eventually earn 
either a bachelor’s (43 percent) or a graduate (43 percent) degree. These data suggest that the 
program in which a student is currently enrolled actually understates, rather than overstates, their 
long-term aspirations. 

Figure 1. 1995-96 First-Time Students in Community Colleges: Highest Degree Ever 

Expected, by Student’s Initial Degree Program 




Certificate Associate Total 

Degree Program 



Source: Authors’ calculations using data from BPS:96/01. 
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Degree completion and transfer data for minority and low-income students present a final 
challenge to the argument that completion at community colleges should not be emphasized (see 
Bailey, Jenkins, & Leinbach, 2005a, 2005b). Even after controlling for high school test scores, 
other personal characteristics, and stated degree goals, socioeconomic status (SES) and 
race/ethnicity continue to be strongly related to the probability of completion (Bailey, Alfonso et 
ah, in press). If this fact represents systematic barriers faced by lower income and minority 
students, then colleges should try to do something about those barriers. Alternatively, if it 
represents systematic differences in aspirations, even after controlling for high school academic 
record, then we should ask why such students have lower aspirations. 

There is no question that community colleges encounter many challenges that affect their ability 
to increase graduation rates. Nevertheless, completion or transfer should be important goals for 
community college students and thus for the colleges themselves. Even among community 
colleges that face similar challenges, certain institutions perform considerably better than others. 
What do these institutions do to achieve better-than-expected results? In the next section, we 
review the available research on that question, and in Section IV we report on our own empirical 
work that seeks to go beyond the existing understanding. 
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Existing Research on Institutional and Individual Effects on Graduation Rates 



Several studies have analyzed the effect of institutional characteristics on graduation rates, 
although the majority of them focus on baccalaureate institutions and use institutional graduation 
rates as the dependent variable. We, however, are interested in the effects at community colleges 
and also recognize limitations to the use of institutional completion rates. Therefore, we discuss 
here only those studies at baccalaureate institutions most infonnative for our analysis of 
community colleges. Also, we divide the literature review into two parts. The first discusses 
research using only institutional factors or student characteristics at the institutional level 
(average SAT scores, for example) that affect institutional graduation rates. This research 
informs our empirical work examining only IPEDS institutional characteristics as explanatory 
variables for community college institutional graduation rates. Since we know that individual 
student characteristics have a significant impact on their outcomes, and we showed above that 
institutional graduation rates underestimate the true rates of student completion, we use data on 
individual student characteristics and graduation rates in a second set of impact models. 
Therefore, the second part of the literature review discusses those studies that incorporate 
individual student characteristics and individual completions into their analysis. 



Research Using Institutional Graduation Rates with Institutional Characteristics 

In a study of baccalaureate institutions, Porter (2000) found that average SAT scores and the 
percent of students who are female were associated with higher graduation rates, while 
institutions with higher percentages of students over age 25 tended to have lower graduation 
rates. Some more structural characteristics, such as expenditures per student, undergraduate 
enrollment, and the availability of on-campus housing, were also related to higher graduation 
rates. Porter showed that perfonnance measures such as graduation rates are sensitive to the 
variables used in the analysis and to the specification of the model. His study also highlights a 
serious methodological problem with this type of research. For example, one might conclude that 
building housing for students might increase graduation rates, but it is also possible that the 
availability of housing attracts a particular type of student who would have a higher likelihood of 
graduating, with or without the housing. Thus, housing might be associated with a college 
graduation rate without increasing the probability that any particular student would graduate. 

Goenner and Snaith (2004) also argued that using different model specifications can lead to 
contrary findings on the factors associated with graduation rates, given the uncertainty about the 
true set of variables that explains the phenomena of interest. They estimate a university 
graduation rates model while accounting for uncertainty in variable selection. Similar to previous 
findings, their results suggest that students’ average GPA or SAT scores are important and 
positive predictors of institutional graduation rates. Furthennore, they found that institutions in 
urban environments, the percentage of Native American students, the percentage of male 
students, and the average age of students are all factors negatively associated with increases in 
the institutional graduation rate. 
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Astin, Tsui, and Avalos (1996) used data from a nationally representative sample of first-time, 
full-time students to compare the graduation rates of 365 baccalaureate institutions in 1985. They 
found that private universities had the highest graduation rates, and believed that this finding 
resulted from the fact that such institutions tend to enroll better prepared students. They also 
found that highly selective institutions and those that enroll large numbers of students in fields 
like business, psychology, and the social sciences have higher graduation rates. Institutions with 
large engineering programs, commuter schools, and larger colleges have lower than expected 
rates. Mortenson (1997) also used a regression model to estimate predicted graduation rates for 
1,100 baccalaureate-granting colleges. He had similar findings to Astin et al. (1996), namely that 
institutions whose students have higher average SAT scores and those with a higher percentage 
of freshmen living on campus had higher graduation rates, while those with many part-time 
students and relatively large engineering programs had lower rates. 

Ryan (2003) used data on 363 baccalaureate institutions to estimate the impact of institutional 
expenditures for instruction, academic support, student services, and administrative support on 
the six-year graduation rates of cohorts within each institution. He controlled for student 
SAT/ACT and other factors. His findings suggest that instructional and academic support 
expenditures have positive and significant effects on cohort graduation rates, as previously 
indicated by Astin (1993). However, expenditures on student services and expenditures on 
administrative (institutional) support failed to produce any significant impact on graduation rates. 
Ryan suggested that there are trade-offs in the utilization of financial resources within an 
institution in terms of degree attainment, and that institutions should be careful when deciding 
where to allocate resources. 

More recently, Scott, Bailey, and Kienzl (2004) conducted an analysis of six-year graduation 
rates for baccalaureate-granting institutions based on data from the College Board’s American 
Survey of Colleges and from IPEDS. They used grouped logistic regression, arguing that the 
ordinary least squares method used by previous researchers is not an appropriate technique since 
graduation rates are constrained within an interval ranging from 0 to 100. Using this new 
methodology, they found that private colleges and those with students with higher average SAT 
scores, a higher proportion of women, and higher instructional expenditures per full-time 
equivalent (FTE) student had higher graduation rates. Institutions with higher proportions of 
minority students, older students, and part-time students had lower graduation rates. In addition, 
they found that institutions with higher in-state tuition also tended to have higher graduation 
rates, even after controlling for student characteristics. 

These studies from the last ten years generally confirm the findings summarized in 1991 by 
Pascarella and Terenzini (1991), who also identified the effects of institutional characteristics on 
student outcomes. They found that colleges with students having higher SAT scores and from 
higher income families, and more full-time and female students, had higher graduation rates. 
Private and residential institutions also had higher rates. Specifically, they found that, at 
baccalaureate institutions, characteristics promoting social integration, such as residential 
campuses, same-sex or same-race institutions, and smaller college size and control (private 
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institutions) have positive impacts on student outcomes. 3 These findings are consistent with the 
implications of Tinto’s integration model (see below). Pascarella and Terenzini also reported 
interesting findings on historically black and women’s colleges: black students enrolling in 
predominantly white colleges are more likely to drop out than are black students who attend a 
Historically Black College or University (HBCU). They hypothesized that black students 
experience higher levels of social integration in HBCUs than in majority white ones. They used 
the same reasoning to argue that attendance at a single-sex institution increases the level of 
persistence and educational attainment of women, although studies indicate that the magnitude of 
this effect is quite small. Finally, the researchers noted that institutional factors such as 
instructional expenditures and selectivity also increase the likelihood of student attainment of a 
bachelor’s degree. 

Table 1 summarizes the institutional characteristics that research has found to be associated with 
attainment by undergraduate students. Again, most of this research has been conducted on 
baccalaureate institutions. 

Table 1. Institutional Characteristics Associated with Bachelor’s Degree Completion 



Institutional Characteristic 


Effect on Degree Completion 


Instructional expenditures 


+ 


Selectivity 


+ 


Social integration 


+ 


Student body compositional characteristics 
• Average student household income 


+ 


• Percent full-time students 


+ 


• Percent female 


+ 



+ = statistically significant positive effect on completion with an increase in the institutional characteristic. 

A recent study by Habley and McClanahan (2004) analyzed the association between outcome 
measures for community college students and institutional practices. Their study was based on 
data collected from 386 colleges (out of 991 that received questionnaires). Colleges were 
classified as “high performing” if their first-to-second year retention rates and their three-year 
graduation rates were both above the median for those rates; they were classified as “low 
performing” if they were below the median for both rates. Colleges were given a list of 82 
retention practices and were asked to report whether or not they used each of them. Respondents 
were also asked to state whether each practice made a “major,” “moderate,” or “no” contribution 
to retention. Of the 82 practices, those that were reported to have more than a “moderate” 
contribution and for which there was at least a 10 percentage point difference in the incidence of 
use between high-performing and low-performing colleges were deemed to be “successful” 
retention practices. This evaluation yielded the following list of “successful” practices: 
mathematics center, writing center, reading center, advising interventions with special 
populations of students, learning communities, foreign language center, and programs for 
racial/ethnic minorities. 



3 However, Pascarella and Terenzini (1991) concluded that, because of conflicting findings from investigations of 
the direct effect of institutional size on student performance, the evidence is inconclusive or at least the effect is 
dependent on individual student characteristics. 
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Habley and McClanahan’s study is unique in that it uses a relatively large sample of community 
colleges and collected data on specific institutional practices. It therefore presents interesting and 
suggestive conclusions. The study does not, however, control for any other institutional 
characteristics (for example, institutional size) and it examines practices one by one, making it 
difficult to determine whether each practice is effective individually or in combination with other 
factors, or whether those measured practices are correlated with some other characteristics 
(either measured or unmeasured) that are the true determining factors. Nevertheless, more 
analyses with these sorts of data are needed. 



Research Using Individual Completions with Individual and Institutional Characteristics 

This section of the literature review examines the contributions of individual characteristics to 
the educational outcomes of community college students. Studies find that student background 
characteristics such as SES, race/ethnicity, gender, academic preparation, and enrollment 
patterns significantly impact their outcomes. 

As with the institutional studies, most of the research on student attainment examines the 
experience of students at baccalaureate institutions and, in many cases, within a single 
institution. The most widely applied models of undergraduate student attainment are Tinto’s 
Student Integration Model (1993) and Bean’s Student Attrition Model (1985). Both models 
consider the “fit” between an institution and the student as a key to persistence. However, 
“institutional fit” refers to a student’s feeling of belonging in the institution, it does not measure 
institutional characteristics or practices. In addition, both Tinto and Bean relied on data from 
only one baccalaureate institution. As a result, their findings cannot be applied to other 
baccalaureate institutions, let alone community colleges, which generally serve students with 
greater rates of multi-institutional attendance. The use of single cases also makes it impossible to 
examine the effects on student attainment of different sorts of institutions and institutional 
practices. Another disadvantage of most institutional studies is that they measure outcomes in 
tenns of persistence and graduation at a given institution. Therefore, for example, students who 
transfer to a baccalaureate institution, a positive outcome for community college students, are not 
captured in such studies. 

Research on community colleges is much less likely to show a positive relationship between 
measures of integration and student persistence and degree completion. Some research found 
small positive effects (Bers & Smith, 1991; Napoli & Wortman, 1998), while other studies found 
no effect and, in at least one case, social integration was found to have a negative effect (Nora, 
Attinasi, & Matonak, 1990). In their review of empirical research on undergraduate student 
attainment, Pascarella and Terenzini (1991) contended that social integration models do not work 
as well for commuter colleges as residential colleges. They stated that “with a few exceptions, 
the weight of evidence is clear that various measures of social integration (including interaction 
with faculty, interaction with peers, and extracurricular involvement) show little if any positive 
relationship with persistence at commuter institutions. This lack of a positive relationship holds 
regardless of the specific measure of social integration used and irrespective of whether or not 
student background characteristics were taken into account in the study design” (p. 402). In a 
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much more recent review of empirical tests of Tinto’s integration model for community colleges, 
Braxton, Hirschy, and McClendon (2004) concluded that “the explanatory power of Tinto’s 
theory to account for student departure in two-year colleges remains undetermined and open to 
empirical treatment.” (pp. 17-18). 

Recent studies have overcome the single-institution focus by using nationally representative 
surveys that track cohorts of students over time, thereby allowing researchers to chart students’ 
progress both within and across multiple institutions (Adelman, 1999; 2003). These recent 
studies have identified the following factors associated with educational attainment at both two- 
year and baccalaureate institutions: academic preparation and achievement, race/ethnicity, 
socioeconomic status, gender; attendance patterns (delayed enrollment, interrupted enrollment, 
and part-time attendance), and children and other household responsibilities (Adelman, 1999; 
2003; Bailey, Alfonso et ah, in press; Cabrera, Burkum, & La Nasa, 2003). However, the models 
in these studies do not account for variation between institutions and their effects on student 
outcomes. That is, they do not consider that the characteristics of the institution that a student 
attends might influence his or her outcome. 

In one interesting exception, Titus (2004; in press) addresses explicitly the effect of institutional 
characteristics on student persistence. He merged two nationally representative datasets 
(BPS:96/98 and IPEDS 1995) to consolidate individual student data with the institutional 
information from the college in which each student enrolled. As with other research cited, his 
work was confined to baccalaureate institutions. He provided evidence that more selective 
institutions and residential institutions are positively associated with student persistence. 
Surprisingly, he also found that larger institutions have significant positive impacts on 
persistence, explained by the belief that larger baccalaureate institutions have stronger 
institutional socialization capabilities and offer degrees possessing higher status. Pascarella and 
Terenzini (1991) also cited research with similar findings, though they noted that other work 
contradicted their conclusions. Because issues of socialization and institutional status are less 
important at community colleges, we may find that institutional size will have an ambiguous 
relationship to student outcomes. 

Other recent research (Alfonso, 2003; Astin et ah, 1996) found that institutional characteristic 
variables have differential effects on degree attainment depending on the race/ethnicity of the 
student. In particular, Alfonso (2003) found that Hispanics who enroll in large community 
colleges are less likely to earn associate degrees than those who attend smaller two-year colleges, 
while blacks’ educational attainment is higher when they attend private two-year colleges. Thus, 
this literature suggests that controlling for institutional characteristics might improve the 
understanding we have about the factors that contribute to educational attainment of minority 
students. 



Implications for this Study 

As we noted, most of the research on institutional factors affecting student outcomes has been 
carried out at baccalaureate institutions. Such studies find that average student characteristics 
such as higher ability, higher family income, and full-time attendance patterns all positively 
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affect outcomes. Furthermore, it is fair to say that there is a consensus among researchers that, on 
average, measures of academic and social integration and fit positively affect persistence and 
degree attainment at baccalaureate institutions. Institutional selectivity is also found to contribute 
to student success. 

These findings, while informative, raise two important concerns when applying similar models to 
studies of community colleges. First, the conceptual basis for applying such models to 
community colleges is weak because of their wholly different character from baccalaureate 
institutions. For one thing, community colleges generally have substantially different structures, 
missions, and funding mechanisms than do most baccalaureate institutions. Furthermore, 
community colleges, as open access institutions, are intentionally non-selective, available to 
students from all income levels, and support part-time enrollment, among other characteristics. 
Studies consistently find that the typical characteristics of students at community college are also 
those characteristics that predict lower graduation rates. 

Second, existing educational attainment models either ignore or use single institutional 
characteristics when trying to explain students’ postsecondary outcomes. Such models fail to 
capture all of the institutional influences contributing to an individual student’s outcome. 

Students are more frequently attending more than one postsecondary institution (Adehnan, 1999; 
2003; Burd, 2004), with each contributing to the intellectual and social development of the 
student and affecting his or her educational outcome. Given the common reality of multi- 
institutional attendance, particularly among students who enter higher education through 
community colleges, studies should incorporate the effect on a student’s educational outcome of 
every institution attended, thus accounting for the entire postsecondary enrollment of a student. 

We find that the focus of much of this research on baccalaureate institutions distorts our 
assumptions about the similar characteristics and relationships at community colleges. Therefore, 
it is important that researchers develop new conceptual models on which to base their research 
on institutional factors affecting student outcomes at community colleges. 

Consequently, as we describe in the subsequent sections, the research models we developed 
extend current research in two ways. First, we examined the outcomes of students who attend 
community colleges. We used a theoretical framework based on the nature of community 
colleges and models that use the characteristics of those institutions. Second, we incorporated 
into the same model both student and institutional characteristics so that we could control for 
student characteristics to more conclusively identify key institutional characteristics that promote 
or detract from student outcomes. 
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